Pose-Guided Feature Disentangling for Occluded Person Re-identification Based on Transformer

نویسندگان

چکیده

Occluded person re-identification is a challenging task as human body parts could be occluded by some obstacles (e.g. trees, cars, and pedestrians) in certain scenes. Some existing pose-guided methods solve this problem aligning according to graph matching, but these graph-based are not intuitive complicated. Therefore, we propose transformer-based Pose-guided Feature Disentangling (PFD) method utilizing pose information clearly disentangle semantic components or joint parts) selectively match non-occluded correspondingly. First, Vision Transformer (ViT) used extract the patch features with its strong capability. Second, preliminarily from information, matching distributing mechanism leveraged Aggregation (PFA) module. Third, set of learnable views introduced transformer decoder implicitly enhance disentangled part features. However, those guaranteed related without additional supervision. Pose-View Matching (PVM) module proposed explicitly visible automatically separate occlusion Fourth, better prevent interference occlusions, design Push Loss emphasize parts. Extensive experiments over five datasets for two tasks (occluded holistic Re-ID) demonstrate that our PFD superior promising, which performs favorably against state-of-the-art methods. Code available at https://github.com/WangTaoAs/PFD_Net

برای دانلود باید عضویت طلایی داشته باشید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Person re-identification by pose priors

The person re-identification problem is a well known retrieval task that requires finding a person of interest in a network of cameras. In a real-world scenario, state of the art algorithms are likely to fail due to serious perspective and pose changes as well as variations in lighting conditions across the camera network. The most effective approaches try to cope with all these changes by appl...

متن کامل

On-the-fly feature importance mining for person re-identification

State-of-the-art person re-identification methods seek robust person matching through combining various feature types. Often, these features are implicitly assigned with generic weights, which are assumed to be universally and equally good for all individuals, independent of people's different appearances. In this study, we show that certain features play more important role than others under d...

متن کامل

Pose Invariant Embedding for Deep Person Re-identification

Pedestrian misalignment, which mainly arises from detector errors and pose variations, is a critical problem for a robust person re-identification (re-ID) system. With bad alignment, the background noise will significantly compromise the feature learning and and matching process. To address this problem, this paper introduces the pose invariant embedding (PIE) as a pedestrian descriptor. First,...

متن کامل

Pose-Normalized Image Generation for Person Re-identification

Person Re-identification (re-id) faces two major challenges: the lack of cross-view paired training data and learning discriminative identity-sensitive and viewinvariant features in the presence of large pose variations. In this work, we address both problems by proposing a novel deep person image generation model for synthesizing realistic person images conditional on pose. The model is based ...

متن کامل

Pose-Driven Deep Models for Person Re-Identification

Person re-identification (re-id) is the task of recognizing and matching persons at different locations recorded by cameras with non-overlapping views. One of the main challenges of re-id is the large variance in person poses and camera angles since neither of them can be influenced by the re-id system. In this work, an effective approach to integrate coarse camera view information as well as f...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: Proceedings of the ... AAAI Conference on Artificial Intelligence

سال: 2022

ISSN: ['2159-5399', '2374-3468']

DOI: https://doi.org/10.1609/aaai.v36i3.20155